Margin based Active Learning for LVQ Networks
نویسندگان
چکیده
In this article, we extend a local prototype-based learning model by active learning, which gives the learner the capability to select training samples and thereby increase speed and accuracy of the model. Our algorithm is based on the idea of selecting a query on the borderline of the actual classification. This can be done by considering margins in an extension of learning vector quantization based on an appropriate cost function. The performance of the query algorithm is demonstrated on real life data.
منابع مشابه
Margin Analysis of the LVQ Algorithm
Prototypes based algorithms are commonly used to reduce the computational complexity of Nearest-Neighbour (NN) classifiers. In this paper we discuss theoretical and algorithmical aspects of such algorithms. On the theory side, we present margin based generalization bounds that suggest that these kinds of classifiers can be more accurate then the 1-NN rule. Furthermore, we derived a training alg...
متن کاملUsing PCA with LVQ, RBF, MLP, SOM and Continuous Wavelet Transform for Fault Diagnosis of Gearboxes
A new method based on principal component analysis (PCA) and artificial neural networks (ANN) is proposed for fault diagnosis of gearboxes. Firstly the six different base wavelets are considered, in which three are from real valued and other three from complex valued. Two wavelet selection criteria Maximum Energy to Shannon Entropy ratio and Maximum Relative Wavelet Energy are used and compared...
متن کاملPerformance analysis of LVQ algorithms: A statistical physics approach
Learning vector quantization (LVQ) constitutes a powerful and intuitive method for adaptive nearest prototype classification. However, original LVQ has been introduced based on heuristics and numerous modifications exist to achieve better convergence and stability. Recently, a mathematical foundation by means of a cost function has been proposed which, as a limiting case, yields a learning rule...
متن کاملInteractive and life-long learning for identification and categorization tasks
The presented thesis focuses on life-long and interactive learning for identification and categorization tasks. The fundamental and still largely unsolved problem of life-long learning with artificial neural networks is the so-called “stability-plasticity dilemma”. To achieve plasticity the learning approach must be able to continuously integrate newly acquired knowledge into its internal repre...
متن کاملAn entropy-LVQ system for S&P500 downward shifts forecasting
Article history: Received July 20, 2011 Accepted 7 October 2011 Available online 8 October 2011 The purpose of this paper is to predict the S&P500 down moves with technical analysis indicators using learning vector quantization (LVQ) neural networks and probabilistic neural networks (PNN). In addition, entropy-based input selection technique is employed to improve the prediction accuracies. The...
متن کامل